Weakly-convex–concave min–max optimization: provable algorithms and applications in machine learning
نویسندگان
چکیده
Min–max problems have broad applications in machine learning, including learning with non-decomposable loss and robustness to data distribution. Convex–concave min–max problem is an active topic of research efficient algorithms sound theoretical foundations developed. However, it remains a challenge design provably for non-convex or without smoothness. In this paper, we study family problems, whose objective function weakly convex the variables minimization concave maximization. We propose proximally guided stochastic subgradient method variance-reduced non-smooth smooth instances, respectively, problems. analyse time complexities proposed methods finding nearly stationary point outer corresponding problem.
منابع مشابه
Provable Algorithms for Machine Learning Problems
Modern machine learning algorithms can extract useful information from text, images and videos. All these applications involve solving NP-hard problems in average case using heuristics. What properties of the input allow it to be solved efficiently? Theoretically analyzing the heuristics is often very challenging. Few results were known. This thesis takes a different approach: we identify natur...
متن کاملComparative Analysis of Machine Learning Algorithms with Optimization Purposes
The field of optimization and machine learning are increasingly interplayed and optimization in different problems leads to the use of machine learning approaches. Machine learning algorithms work in reasonable computational time for specific classes of problems and have important role in extracting knowledge from large amount of data. In this paper, a methodology has been employed to opt...
متن کاملMachine learning algorithms in air quality modeling
Modern studies in the field of environment science and engineering show that deterministic models struggle to capture the relationship between the concentration of atmospheric pollutants and their emission sources. The recent advances in statistical modeling based on machine learning approaches have emerged as solution to tackle these issues. It is a fact that, input variable type largely affec...
متن کاملSpatiotemporal Estimation of PM2.5 Concentration Using Remotely Sensed Data, Machine Learning, and Optimization Algorithms
PM 2.5 (particles <2.5 μm in aerodynamic diameter) can be measured by ground station data in urban areas, but the number of these stations and their geographical coverage is limited. Therefore, these data are not adequate for calculating concentrations of Pm2.5 over a large urban area. This study aims to use Aerosol Optical Depth (AOD) satellite images and meteorological data from 2014 to 2017 ...
متن کاملPractical Bayesian Optimization of Machine Learning Algorithms
The use of machine learning algorithms frequently involves careful tuning of learning parameters and model hyperparameters. Unfortunately, this tuning is often a “black art” requiring expert experience, rules of thumb, or sometimes bruteforce search. There is therefore great appeal for automatic approaches that can optimize the performance of any given learning algorithm to the problem at hand....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Optimization Methods & Software
سال: 2021
ISSN: ['1055-6788', '1026-7670', '1029-4937']
DOI: https://doi.org/10.1080/10556788.2021.1895152